Title: Cerebral Correlates and Statistical Criteria of Cross-modal Face and Voice Integration Short title: Face-voice Integration

نویسندگان

  • Scott Love
  • Frank E. Pollick
  • Marianne Latinus
چکیده

Perception of faces and voices plays a prominent role in human social interaction, making multisensory integration of cross-modal speech a topic of great interest in cognitive neuroscience. How to define potential sites of multisensory integration using functional magnetic resonance imaging (fMRI) is currently under debate, with three statistical criteria frequently used (e.g. super-additive, max and mean criteria). In the present fMRI study, 20 participants were scanned in a block design under three stimulus conditions: dynamic unimodal face, unimodal voice and bimodal face-voice. Using this single dataset, we examine all these statistical criteria in an attempt to define loci of face-voice integration. While the super-additive and mean criteria essentially revealed regions in which one of the unimodal responses was a deactivation, the max criteria appeared stringent and ∗To whom correspondence should be addressed. E-mail: [email protected]

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The effects of anxiety on the perception of emotion in the face and voice

Anxious individuals have been shown to be hyper-sensitive to cues for others’ negative emotional states. As most studies used facial expressions as emotional cues, we examined whether the trait anxiety affects the cross-modal perception of emotion in the face and voice that were simultaneously presented. The face and voice cues conveyed either matched (e.g., both positive) or mismatched emotion...

متن کامل

Cross-modal Bias of Voice Tone on Facial Expression: Upper versus Lower Halves of a Face

Emotional states are communicated by seeing the face as well as by listening to affective prosody. The two inputs can also be present at the same time and are then processed concurrently. The present experiment examines the role of the voice on the upper versus lower halves of a face. Previous research using an angry-fear facial expression continuum showed that recognition of the lower half of ...

متن کامل

Dissociating task difficulty from incongruence in face-voice emotion integration

In the everyday environment, affective information is conveyed by both the face and the voice. Studies have demonstrated that a concurrently presented voice can alter the way that an emotional face expression is perceived, and vice versa, leading to emotional conflict if the information in the two modalities is mismatched. Additionally, evidence suggests that incongruence of emotional valence a...

متن کامل

Is cross-modal integration of emotional expressions independent of attentional resources?

In this study, we examined whether integration of visual and auditory information about emotions requires limited attentional resources. Subjects judged whether a voice expressed happiness or fear, while trying to ignore a concurrently presented static facial expression. As an additional task, the subjects had to add two numbers together rapidly (Experiment 1), count the occurrences of a target...

متن کامل

Neurobiological correlates of emotional intelligence in voice and face perception networks

Facial expressions and voice modulations are among the most important communicational signals to convey emotional information. The ability to correctly interpret this information is highly relevant for successful social interaction and represents an integral component of emotional competencies that have been conceptualized under the term emotional intelligence. Here, we investigated the relatio...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011